Communication device and non-transitory computer-readable medium

ABSTRACT

A non-transitory computer-readable medium stores computer-readable instructions performing processes including a determination, a setting, a first generation, a second generation and a transmission operations. The determination operation determines whether a communication state is a first or second state based on at least one of transmission data transmitted by the communication device to a conference server and reception data received by the communication device from the conference server. The setting operation sets a combined time to a first or second period of time in response to the determination operation. The first generation operation generates sound data corresponding to the combined time, by sequentially compressing sampling data corresponding to the combined time in an order of storage in a first storage portion. The second generation operation generates a packet including the sound data. The transmission operation transmits the packet to the conference server at a cycle corresponding to the combined time.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to Japanese Patent Application No.2013-246882 filed on Nov. 29, 2013, the disclosure of which is hereinincorporated by reference in its entirety.

BACKGROUND

The present disclosure relates to a communication device that is capableof communication with a plurality of counterpart devices via a network,and to a non-transitory computer-readable medium.

A system is known that allows spoken communication between users of eachof a plurality of communication devices. In this system, each of theplurality of communication devices performs communication of data ofsound (hereinafter referred to as sound data) with the othercommunication devices. As known technology, a technology is disclosed inwhich a transmission interval of an audio data packet from atransmitting device is equal to or less than 60 milliseconds(hereinafter, millisecond and milliseconds are referred to as ms), ormore preferably, is approximately 20 ms. According to this technology,even if a data packet is lost during communication, the user of areceiving device does not easily notice a gap in the conversationalvoice.

SUMMARY

A time that is required for each of a plurality of sound datatransmitted from a specific communication device to reach anothercommunication device via a network may vary, depending on networkconditions and so on. Hereinafter, the time required from when the sounddata is transmitted from the specific communication device to the timeat which the sound data is received by the other communication device isreferred to as a delay time. Variations in the delay time of each of theplurality of sound data are referred to as jitter. In order to maintainthe quality of spoken communication, it is desirable for jitter to below.

When jitter is high, even when the specific communication devicetransmits the plurality of sound data at a constant cycle, using theabove-described known technology, an interval at which the plurality ofsound data are received by the other communication device becomesunstable. In this case, an interval at which the other communicationdevice outputs sound based on each of the plurality of sound data alsobecomes unstable. As a result, when there is a long interval between thesound output by the other communication device, there is a possibilitythat gaps occur in the output sound. Thus, the above-described knowntechnology does no more than set the transmission interval of theplurality of sound data from the specific communication device as apredetermined interval, and cannot reduce the jitter when the pluralityof sound data are received by the other communication device.

On the other hand, as known technology that inhibits deterioration inspoken communication quality caused by jitter, a technology is known inwhich a predetermined amount of the sound data is constantly stored(i.e., buffered) in a storage device (a RAM or the like) by thereceiving side communication device and the receiving side communicationdevice outputs sound based on the stored sound data. When this knowntechnology is used, a time required from when the plurality of pieces ofsound data are transmitted from the specific communication device towhen the sound based on the plurality of pieces of sound data is outputby the other communication device becomes long. As a result, even whenthis known technology is used, there is a case in which a “real-time”feeling of the conversation (i.e., instantaneity) deteriorates.

Various exemplary embodiments of the general principles described hereinprovide a communication device that inhibits a deterioration in spokencommunication quality by reducing jitter, and a non-transitorycomputer-readable medium.

The embodiments described herein provide a non-transitorycomputer-readable medium storing computer-readable instructions. Theinstructions, when executed by a processor of a communication deviceconfigured to connect a network, perform processes including a firstjudgment operation, a first generation operation, a storage operation, adetermination operation, a setting operation, a second judgmentoperation, a second generation operation and a transmission operation.

The first judgment operation is an operation that judges whethersampling data of sound corresponding to a period of time equal to orgreater than a predetermined period of time is stored in a first storageportion. The first generation operation is an operation thatsequentially generates, in response to the first judgment operationjudging that the sampling data of sound for the first period of timeequal to or greater than the predetermined period of time is stored inthe first storage portion, unit sound data, by sequentially compressingthe sampling data that corresponds to the predetermined period of timeand that is stored in the first storage portion, in an order of storagein the first storage portion. The storage operation is an operation thatstores the unit sound data. The determination operation is an operationthat determines whether a communication state of the network is one of afirst state and a second state different from the first state, based onat least one of transmission data that is transmitted to the network andreception data that is received from the network. The setting operationis an operation that sets a combined time that corresponds to a lengthof time of sound in sound data included in a single packet. The combinedtime is set to one of a first period of time and a second period of timelonger than the first period of time. The combined time is set to thefirst period of time when the determination operation determines thatthe communication state is the first state. Further, the combined timeis set to the second period of time when the determination operationdetermines that the communication state is the second state. The secondjudgment operation is an operation that judges whether the unit sounddata corresponding to a period of time equal to or greater than thecombined time is stored in the second storage portion. The secondgeneration operation is an operation that, in response to the secondjudgment operation judging that the unit sound data corresponding to theperiod of time equal to or greater than the combined time is stored inthe second storage portion, generates the packet that includes the unitsound data corresponding to the combined time. The transmissionoperation is an operation that transmits, to at least one counterpartdevice at a cycle corresponding to the combined time, the packetgenerated by the second generation operation.

The embodiments described herein also provide a communication device.The communication device includes a processor and a memory storingcomputer-readable instructions. When executed by the processor of thecommunication device, the instructions perform processes including afirst judgment operation, a first generation operation, a storageoperation, a determination operation, a setting operation, a secondjudgment operation, a second generation operation and a transmissionoperation. Each of the operations is similar to that of thenon-transitory computer-readable medium.

The embodiments described herein also provide a non-transitorycomputer-readable medium storing computer-readable instructions. Whenexecuted by a processor of a communication device, the instructionsperform processes including a determination operation, a settingoperation, a first generation operation, a second generation operationand a transmission operation.

The determination operation is an operation that determines whether acommunication state with a conference server via a network is one of afirst state and a second state different from the first state, based onat least one of transmission data that is transmitted by thecommunication device to the conference server, which is capable of datacommunication with the communication device via the network, andreception data that is received by the communication device from theconference server. The setting operation is an operation that sets afirst period of time as a combined time in response to the determinationoperation determining that the communication state is the first state,and sets, as the combined time, a second period of time that is longerthan the first period of time in response to the determination operationdetermining that the communication state is the second state. The firstgeneration operation is an operation that generates, from sampling dataof sound that is stored in a first storage portion, sound datacorresponding to the combined time, by sequentially compressing thesampling data corresponding to the combined time in an order of storagein the first storage portion. The second generation operation is anoperation that generates a packet including the sound data. Thetransmission operation is an operation that transmits the packet to theconference server at a cycle corresponding to the combined time.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments will be described below in detail with reference to theaccompanying drawings in which:

FIG. 1 is a diagram showing an overview of a teleconference system andan electrical configuration of a communication device and a server;

FIG. 2 is a diagram showing a flow of signals and data relating to soundin the teleconference system;

FIG. 3 is a diagram illustrating a transmission cycle;

FIG. 4 is a flowchart of device-side first processing;

FIG. 5 is a flowchart of device-side second processing;

FIG. 6 is a flowchart of device-side third processing;

FIG. 7 is a flowchart of device-side fourth processing;

FIG. 8 is a diagram showing a table 1142;

FIG. 9 is a flowchart of first setting processing:

FIG. 10 is a diagram showing a table 1141;

FIG. 11 is a flowchart of second setting processing;

FIG. 12 is a flowchart of server-side first processing; and

FIG. 13 is a flowchart of server-side second processing.

DETAILED DESCRIPTION

A teleconference system 1 will be explained with reference to FIG. 1.The teleconference system 1 is provided with communication devices 11,12 and 13 and a server 16. Hereinafter, the communication devices 11 to13 will sometimes be collectively referred to as a communication device15 or as communication devices 15. The communication device 15 and theserver 16 are connected such that they can perform communication via anetwork 20. The communication device 15 is a known smart phone. Theserver 16 is a known multi-point control unit (MCU). Note that at leastone of the communication devices 11 to 13 may be a terminal dedicated toteleconferencing, a general-purpose personal computer (PC), a tablet PCor the like. The server 16 may be a general-purpose server.

An electrical configuration of the communication device 15 will beexplained. The communication device 15 is provided with a CPU 111 thatcontrols the communication device 15. The CPU 111 is electricallyconnected to a ROM 112, a RAM 113, a storage portion 114, a camera 115,a display 116, a communication I/F 117, an input portion 118, an A/Dconverter 119, a D/A converter 121 and a drive device 123.

A boot program and a basic input/output system (BIOS) etc. are stored inthe ROM 112. A timer, a counter, flag information and other temporarydata etc. are stored in the RAM 113. Note that the timer is updated at apredetermined period (1 ms, for example) by a timer function that isprovided in an operating system (OS) that will be explained later.Further, a first storage portion 15A, a second storage portion 15B and athird storage portion 15C (refer to FIG. 2) are provided, as storageareas, in the RAM 113. The storage portion 114 is configured by acomputer-readable non-transitory storage medium, such as a flash memory,for example. However, the storage portion 114 may be configured by ahard disk and/or a ROM etc. It is sufficient if the non-transitorystorage medium is a storage medium that is able to store informationirrespective of a period of storage of the information. Thenon-transitory storage medium need not necessarily include signals thatare temporarily transferred. Application programs (hereinafter, simplyreferred to as “programs”) that cause the CPU 111 to execute device-sidefirst processing (refer to FIG. 4), device-side second processing (referto FIG. 5), device-side third processing (refer to FIG. 6) anddevice-side fourth processing (refer to FIG. 7) are stored in thestorage portion 114, along with the OS. Further, a table 1141 (refer toFIG. 10) and a table 1142 (refer to FIG. 8) are stored in the storageportion 114.

The display 116 is a liquid crystal display (LCD). The communication I/F117 is an interface element (a Wi-Fi communication modem, for example)that is used by the communication device 15 to perform wirelesscommunication by connecting with an access point (not shown in thedrawings) that is connected to the network 20. The CPU 111 transmits andreceives packets to and from the server 16, via the communication I/F117. The input portion 118 includes physical buttons and/or a touch pad,for example. The touch pad is an electrostatic capacitance type positioninput device, for example, and outputs a signal that indicates acoordinate position corresponding to a contact position of a finger of auser. The touch pad may be configured by another type of position inputdevice, such as a resistive membrane type device or an ultrasonicsensing device etc. A touch panel may be configured by superimposing thetouch pad that is included in the input portion 118 on the display 116.The A/D converter 119 is electrically connected to a microphone 120, viaan analog amplifier circuit (a microphone amplifier or the like) that isnot shown in the drawings. The D/A converter 121 is electricallyconnected to a speaker 122, via an analog amplifier circuit (a speakeramplifier or the like) that is not shown in the drawings. The drivedevice 123 can read out information that is stored in acomputer-readable storage medium 1231, such as a semi-conductor memoryor the like. The CPU 111 can use the drive device 123 to read out aprogram that is stored in the storage medium 1231 and store the programin the storage portion 114.

Note that a general-purpose processor may be used as the CPU 111. Thepresent disclosure should not be limited by a configuration that thedevice-side first processing to the device-side fourth processing areexecuted by the CPU 111. That is, the device-side first processing tothe device-side fourth processing may be executed by another electronicdevice (an ASIC, for example). The device-side first processing to thedevice-side fourth processing may be performed as distributed processingby a plurality of electronic devices (that is, a plurality of CPUs). Forexample, a part of the device-side first processing to the device-sidefourth processing may be executed by a server that is connected to thenetwork 20. For example, the program may be downloaded from the serverthat is connected to the network 20 (namely, the program may betransmitted to the communication device 15 as a transmission signal),and may be stored in the storage portion 114 of the communication device15. In this case, the program is stored in a non-transitory storagemedium, such as an HDD, provided in the server. The communication I/F117 may be an interface element (a LAN card, for example) that connectsthe communication device 15 to the network 20 by a wired connection.

An electrical configuration of the server 16 will be explained. Theserver 16 is provided with a CPU 161 that controls the server 16. TheCPU 161 is electrically connected to a ROM 162, a RAM 163, a storageportion 164, a communication I/F 165 and a drive device 166. A bootprogram and a BIOS etc. are stored in the ROM 162. A timer, a counterand other temporary data are stored in the RAM 163. Programs that causethe CPU 161 to execute server-side first processing (refer to FIG. 12)and server-side second processing (refer to FIG. 13) are stored in thestorage portion 164, along with an OS. The communication I/F 165 is aninterface element (a LAN card, for example) that connects the server 16to the network 20. The CPU 161 performs transmission and reception ofdata with the communication device 15, via the communication I/F 165.The drive device 166 can read out information that is stored in astorage medium 1661. The CPU 161 can use the drive device 166 to readout a program that is stored in the storage medium 1661 and store theprogram in the storage portion 164.

A flow of signals and data relating to sound in the teleconferencesystem 1 will be explained with reference to FIG. 2. The microphone 120collects sound, such as the voice etc., of the user using thecommunication device 15. The microphone 120 converts the collected soundto an analog electric signal and outputs the signal to the analogamplifier circuit that is not shown in the drawings. The analogamplifier circuit amplifies the input analog electric signal and outputsthe amplified signal to the A/D converter 119. The A/D converter 119samples the input analog electric signal at a predetermined samplingrate (44.1 kHz, for example) and converts the analog electric signal toa digital electric signal. The A/D converter 119 outputs the digitalelectric signal to the CPU 111. The CPU 111 converts the input digitalelectric signal to data and generates sampling data 151. The CPU 111stores the generated sampling data 151 in the first storage portion 15Aof the RAM 113. The sampling data 151 is stored in the first storageportion 15A in an order in which the sound is collected by themicrophone 120.

The CPU 111 acquires the sampling data 151 stored in the first storageportion 15A in 20 ms chunks, in the order in which the sampling data 151is stored in the first storage portion 15A, and compresses (e.g.,encodes) the data in accordance with a specific compression system.Hereinafter, the compressed sampling data is referred to as compresseddata and the compressed data of 20 ms is referred to as unit sound data.The CPU 111 stores generated unit sound data 152 in the second storageportion 15B of the RAM 113. When 20 ms or more of the sampling data 151is stored in the first storage portion 15A, the CPU 111 repeats theprocessing to generate the unit sound data 152 and store the unit sounddata in the second storage portion 15B.

It should be noted that hereinafter, for ease of understanding, anexplanation is made in which each of a plurality of 20 ms chunks ofcompressed data is stored in the second storage portion 15B as the unitsound data 152, as shown in FIG. 2. Here, in a state in which each ofthe plurality of 20 ms chunks of compressed data is stored in the secondstorage portion 15B, the compressed data may be aggregated withoutdistinguishing between each of the chunks of data. In other words, inthe second storage portion 15B, compressed data corresponding to thetime 20 ms×N may be stored, where N (an integer of 1 or more) is anumber of times that the unit sound data 152 has been generated.

The CPU 111 sets a combined time. The combined time indicates a timeperiod of sound in sound data included in a communication packet 153.The communication packet 153 is transmitted from the communicationdevice 15 to the other communication devices 15 participating in ateleconference. The communication packet 153 includes one or a pluralityof the pieces of unit sound data 152. Further, the combined timeindicates a transmission cycle when transmitting the communicationpacket 153. The combined time is set based on an extent of variations ina delay time from a time of transmission of a measurement packet to theserver 16 to a time of reception of a measurement packet that isreturned from the server 16. Hereinafter, the extent of variations inthe delay time is referred to as jitter. The method of setting thecombined time will be explained in detail later.

The CPU 111 generates the communication packet 153 that includes thecompressed data corresponding to the combined time. Note that a numberof pieces of the unit sound data 152 corresponding to the combined timeare included in the generated communication packet 153. For example,when the combined time is set to 40 ms, the CPU 111 generates thecommunication packet 153 that includes two pieces of the unit sound data152 (20 ms×2=40 ms). Note also that, while in FIG. 2 only the two piecesof unit sound data 152 are shown as the communication packet 153, inactuality, header information that is necessary to perform communicationvia the network 20 is added to the two pieces of unit sound data 152. Inthe above-described case, the CPU 111 transmits the generatedcommunication packet 153 to the server 16 at a cycle corresponding tothe set combined time, namely, every 40 ms.

It should be noted that the processing in which the digital electricsignal output from the A/D converter 119 is converted to data and thesampling data 151 is generated, and then stored in the first storageportion 15A, and the processing in which the generated communicationpacket 153 is transmitted are executed by the CPU 111 as one function ofthe OS. On the other hand, the processing in which the sampling data 151stored in the first storage portion 15A is compressed and the unit sounddata 152 is generated, and the processing in which the communicationpacket 153 that includes at least one piece of the unit sound data 152is generated are executed by the CPU 111 operating based on programs ofthe device-side first processing to the device-side fourth processing(refer to FIG. 4 to FIG. 10).

As shown in FIG. 3, the CPU 111 changes the time period of the sound ofthe sound data included in the communication packet 153 and thetransmission cycle of the communication packet 153, depending on the setcombined time. When the combined time is 20 ms, the sound datacorresponding to 20 ms (one piece of the unit sound data 152) isincluded in the communication packet 153 and the communication packet153 is transmitted at a 20 ms cycle. Similarly, when the combined timeis 40 ms, 60 ms, 80 ms, 100 ms and 120 ms, the sound data correspondingto 40 ms (two pieces of the unit sound data 152), 60 ms (three pieces ofthe unit sound data 152), 80 ms (four pieces of the unit sound data152), 100 ms (five pieces of the unit sound data 152) and 120 ms (sixpieces of the unit sound data 152) are respectively included in thecommunication packet 153, and the communication packet 153 istransmitted at a cycle of 40 ms, 60 ms, 80 ms, 100 ms and 120 ms,respectively. Note that, in the case of any of the combined times, thetotal amount of the unit sound data 152 that is transmitted from thecommunication device 15 to the other communication devices 15 does notchange.

The longer the transmission cycle of the communication data transmittedfrom the communication device 15, the lower the jitter. Jitter arisesdue to variations in the time needed for the processing to performcommunication of the communication packet 153 between the communicationdevice 15, the server 16 and relay devices not shown in the drawings (arouter, a server etc.) that are located in the network 20. As a result,the longer the transmission cycle of the communication data, the lowerthe frequency of the processing needed to perform the communication ofthe communication packet 153, and the lower the jitter that is caused byvariations in the processing time. On the other hand, the longer thetransmission cycle of the communication data, the larger the delay timeof the sound data, and it is therefore preferable to have as small atransmission cycle as possible. Therefore, in order for theteleconference to be performed smoothly between the users, thecommunication device 15 sets the appropriate combined time depending ona communication state of the network 20. This will be explained in moredetail later.

As shown in FIG. 2, the CPU 161 of the server 16 receives thecommunication packet 153 transmitted from the communication device 15via the network 20. The CPU 161 identifies the teleconference in whichthe communication device 15 that has sent the communication packet 153is participating, and identifies the other communication devices 15 thatare participating in the teleconference. The CPU 161 relays the receivedcommunication packet 153 to the other identified communication devices15.

When the CPU 111 of the communication device 15 has received thecommunication packet 153 from the server 16 via the network 20, the CPU111 acquires a number of pieces (that correspond to the combined time)of the unit sound data 152 included in the received communication packet153. The CPU 111 expands (decodes) the acquired unit sound packet andrestores it to the original sampling data. The CPU 111 stores thesampling data in the third storage portion 15C of the RAM 113. The CPU111 acquires the sampling data stored in the third storage portion 15Cin chunks of 20 ms, in the order in which the sound was collected by themicrophone 120. The CPU 111 outputs, to the D/A converter 121, a digitalelectric signal corresponding to the acquired sampling data. The D/Aconverter 121 converts the input digital electric signal to an analogelectric signal. The D/A converter 121 outputs the analog electricsignal to the analog amplifier circuit that is not shown in thedrawings. The analog amplifier circuit amplifies the input analogelectric signal and outputs the amplified signal to the speaker 122. Thespeaker 122 outputs sound corresponding to the input analog electricsignal.

Note that the processing in which the packet is received, and theprocessing in which the digital electric signal corresponding to thesampling data stored in the third storage portion 15C is output to theD/A converter 121 are executed by the CPU 111 as one function of the OS.On the other hand, the processing in which the at least one piece ofunit sound data 152 included in the received packet is expanded andrestored to the original sampling data and is stored in the thirdstorage portion 15C is executed by the CPU 111 operating based onprograms that execute processing that is not shown in the drawings.

By the above-described processing being executed, it is possible forspoken communication to be performed between the users of thecommunication devices 15 participating in the teleconference. It shouldbe noted that only the flow of the signals and the data relating tosound has been explained above, but in actuality, packets including dataof shared document and video that are displayed on the display portions116 of the communication devices 15 are also transmitted and receivedbetween the communication devices 15 participating in theteleconference, via the server 16. The shared document includesexplanatory materials etc. relating to the teleconference, to which eachof the users refers during the teleconference. The video includes videoshowing a situation of the user etc. that is captured by the camera 115.Each of the users of each of the communication devices 15 can performthe teleconference with the other users of the other communicationdevices 15 using the shared document and video displayed on the display116 and using the sound output from the speaker 122.

The device-side first processing to the device-side fourth processingexecuted by the CPU 111 of the communication device 15 will be explainedwith reference to FIG. 5 to FIG. 10. The device-side first processing isstarted by the CPU 111 executing a program stored in the storage portion114 when an operation to activate the teleconference application isinput via the input portion 118. The device-side second processing tothe device-side fourth processing are started by processing at step S13(to be explained later) of the device-side first processing. Thedevice-side first processing to the device-side fourth processing areexecuted in parallel.

Note that, in the following explanation, a specific explanation is madeof an example of a case in which each of the users of the communicationdevices 11 to 13 participates in a common teleconference, and thedevice-side first processing to the device-side fourth processing areperformed by the CPU 111 of the communication device 11. For example,before a scheduled date and time for the teleconference, an electronicmail is transmitted from the server 16 to each of electronic mailaddresses corresponding to the communication devices 11 to 13 that areto participate in the teleconference. The electronic mail includes auniform resource locator (URL) for the teleconference by thecommunication devices 11 to 13. This URL is unique to each conferenceroom of the teleconference. In other words, an ID (a conference ID) thatidentifies the teleconference is included in the URL.

When the example of the communication device 11 is given, the user ofthe communication device 11 operates the communication device 11 at thescheduled date and time of the teleconference. In the communicationdevice 11, the CPU 111 determines whether or not the input portion 118has detected an input corresponding to the URL that includes theconference ID (step S11). When the input corresponding to the URL thatincludes the conference ID has not been detected (no at step S11), theCPU 111 returns the processing to step S11. When the input correspondingto the URL that includes the conference ID has been detected (yes atstep S11), the CPU 111 accesses the server 16 via the communication I/F117, and performs conference connection processing. As a result of theconference connection processing, a teleconference session isestablished between the communication device 11 and the server 16, and ateleconference connection is established between the communicationdevice 11 and the server 16. A similar operation is performed on each ofthe communication devices 12 and 13. In this manner, the teleconferencesession is established between the server 16 and each of thecommunication devices 12 and 13, and the teleconference connection isestablished between the server 16 and each of the communication devices12 and 13.

The CPU 161 of the server 16 associates the conference ID included inthe URL with an ID (a device ID) that identifies each of thecommunication devices 11 to 13 and stores the associated IDs as amanagement table in the storage portion 164. The teleconference betweenthe communication devices 11 to 13 is started in this way.

The CPU 111 starts processing that converts a digital electric signaloutput from the A/D converter 119 to data, generates sampling data andstores the sampling data in the first storage portion 15A. Note thatthis processing is executed as a function of the OS and is performed inparallel with the device-side first processing. The CPU 111 starts thedevice-side second processing (refer to FIG. 5), the device-side thirdprocessing (refer to FIG. 6) and the device-side fourth processing(refer to FIG. 7) (step S13).

The device-side second processing will be explained with reference toFIG. 5. The CPU 111 determines whether or not sampling datacorresponding to a time period equal to 20 ms or more is stored in thefirst storage portion 15A (step S83). When it is determined that thesampling data corresponding to 20 ms or more is not stored in the firststorage portion 15A (no at step S83), the CPU 111 advances theprocessing to step S91. When it is determined that the sampling datacorresponding to 20 ms or more is stored in the first storage portion15A (yes at step S83), the CPU 111 acquires 20 ms chunks of the samplingdata in the order in which the sampling data is stored in the firststorage portion 15A (step S85). When the CPU 111 has acquired 20 ms ofthe sampling data, the CPU 111 deletes the acquired sampling data fromthe first storage portion 15A in order to secure the storage capacity ofthe first storage portion 15A.

Note that the CPU 111 continuously performs the processing in which thesampling data is generated and stored in the first storage portion 15Aas a function of the OS. Thus, a cycle at which the CPU 111 acquires 20ms of the sampling data from the first storage portion 15A by theprocessing at step S85 is substantially the same as the 20 ms cycle atwhich 20 ms of the sampling data is newly stored in the first storageportion 15A.

The CPU 111 compresses the acquired 20 ms of sampling data and generatesthe unit sound data 152 (step S87). The CPU 111 stores the generatedunit sound data 152 in the second storage portion 15B (step S89). Asdescribed above, as the sampling data is acquired from the first storageportion 15A at the cycle of 20 ms, a cycle at which the generated unitsound data 152 is stored in the second storage portion 15B is alsoapproximately 20 ms.

The CPU 111 determines whether or not an input operation to end theteleconference has been detected via the input portion 118 (step S91).When it is determined that the input operation to end the teleconferencehas not been detected (no at step S91), the CPU 111 returns theprocessing to step S83. When it is determined that the input operationto end the teleconference has been detected (yes at step S91), the CPU111 ends the device-side second processing.

The device-side third processing will be explained with reference toFIG. 6. The CPU 111 determines whether or not a transmission timing totransmit a measurement packet to the server 16 has been reached, wherethe measurement packet is transmitted to the server 16 at a constantcycle T1 (1 s, for example) (step S101). When it is determined that thetransmission timing of the measurement packet has not been reached (noat step S101), the CPU 111 advances the processing to step S123. When itis determined that the transmission timing of the measurement packet hasbeen reached (yes at step S101), the CPU 111 acquires from the OS a timet1, which is a point in time at which it is determined that thetransmission timing has been reached, and stores the time t1 in the RAM113 (step S103). The CPU 111 transmits the measurement packet to theserver 16 (step S105). The measurement packet is a packet that can betransmitted via the network 20, and includes dummy data of apredetermined size.

The CPU 111 determines whether or not the measurement packet that isreturned from the server 16 in response to the transmission of themeasurement packet has been received (step S107). When it is determinedthat the measurement packet has not been received (no at step S107), theCPU 111 returns the processing to step S107. When it is determined thatthe measurement packet returned from the server 16 has been received(yes at step S107), the CPU 111 acquires from the OS a time t2, which isa point in time at which it is determined that the measurement packethas been received, and stores the time t2 in the RAM 113 (step S109).The CPU 111 acquires the time t1 and the time t2 stored in the RAM 113.The CPU 111 calculates the elapsed time from the time t1 to the time t2as the delay time, and stores the delay time in the RAM 113 (step S111).The delay time is a turnaround time obtained by adding a communicationtime taken for the measurement packet transmitted from the communicationdevice 11 to arrive at the server 16 to a communication time taken forthe measurement packet transmitted from the server 16 to arrive at thecommunication device 11. It should be noted that, in place of thededicated measurement packets, the processing at step S105 and at stepS107 may be achieved by a PING command, which is provided as standard inthe OS and is operated in accordance with an internet control messageprotocol (ICMP).

The CPU 111 determines whether or not a cycle T2 (10 s, for example),which is longer than the cycle T1 at which the measurement packet istransmitted, has elapsed from when a jitter value is finally calculatedby processing at step S117 and step S119 that will be explained later(step S115). When it is determined that the cycle T2 has not elapsedfrom when the jitter value is finally calculated (no at step S115), theCPU 111 advances the processing to step S123.

When the cycle T2 has elapsed from when the jitter value is finallycalculated, a plurality of delay times that have not been used whencalculating a standard deviation by the processing at step S117 (to beexplained later) are stored in the RAM 113. When it is determined thatthe cycle T2 has elapsed from when the jitter value is finallycalculated (yes at step S115), the CPU 111 uses the plurality of delaytimes stored in the RAM 113 to calculate an average value and then usesthe calculated average value to calculate a standard deviation σ (stepS117). The CPU 111 deletes the delay times used to calculate thestandard deviation σ from the RAM 113. The CPU 111 calculates 3σ as thejitter value (step S119). The CPU 111 transmits a first notificationpacket, which includes the device ID of the communication device 11 andthe calculated jitter value, to the server 16 (step S121).

Note that the method of calculating the standard deviation σ need notnecessarily be limited to the above-described method. For example, theCPU 111 may use a RAM 113 as a ring buffer. The CPU 111 may store thecalculated delay times in order in the ring buffer (step S111). Of theplurality of delay times stored in the ring buffer, the CPU 111 mayacquire a predetermined number of the delay times in order from a mostrecent storage timing. The CPU 111 may calculate the standard deviationa using the acquired predetermined number of delay times. It should benoted that, when the ring buffer is used, the CPU 111 does not delete,from the ring buffer, the delay times acquired to calculate the standarddeviation σ. In this manner, the CPU 111 can calculate the standarddeviation σ using a number of the delay times that is larger than thenumber of delay times calculated during the cycle T2.

The CPU 111 determines whether or not the input operation to end theteleconference has been detected via the input portion 118 (step S123).When it is determined that the input operation to end the teleconferencehas not been detected (no at step S123), the CPU 111 returns theprocessing to step S101. When it is determined that the input operationto end the teleconference has been detected (yes at step S123), the CPU111 ends the device-side third processing.

The device-side fourth processing will be explained with reference toFIG. 7. The CPU 111 determines whether or not a second notificationpacket transmitted from the server 16 has been received (step S131).When it is determined that the second notification packet has not beenreceived (no at step S131), the CPU 111 advances the processing to stepS137. When it is determined that the second notification packet has beenreceived (yes at step S131), the CPU 111 acquires the device ID and thejitter value that are included in the second notification packet. TheCPU 111 associates the acquired device ID and the jitter value andstores the associated data in the table 1142 that is stored in thestorage portion 114 (step S135).

The table 1142 will be explained with reference to FIG. 8. The table1142 includes the device ID, the jitter value and a jitter value forcomparison. The device ID and the jitter value respectively correspondto the device ID and the jitter value included in the secondnotification packet. The jitter value for comparison is used when jittervalues are compared at step S17 to be explained later (refer to FIG. 4).

For example, as the communication devices 11 to 13 are participating inthe same teleconference, the CPU 111 of each of the communicationdevices 11 to 13 performs the device-side third processing (refer toFIG. 6) and the first notification packets are thus transmitted to theserver 16 (step S121, refer to FIG. 6). As will be explained in moredetail later, when the server 16 has received the first notificationpacket from each of the communication devices 11 to 13, the server 16transmits, to each of the communication devices 11 to 13, the secondnotification packet that includes the device ID and the jitter valueincluded in each of the first notification packets. As a result, thedevice ID and the jitter value of each of all the communication devices11 to 13 participating in the teleconference are stored in the table1142 in association with each other. Note that there are cases in whichthe device ID that is newly stored in the table 1142 by the processingat step S135 (refer to FIG. 7) is already stored in the table 1142. Inthis case, the CPU 111 stores the jitter value that is associated withthe already stored device ID as the jitter value for comparison in thetable 1142. Next, the CPU 111 stores the jitter value to be newly storedin the table 1142 in association with the device ID to be newly stored.In other words, the already stored jitter value is updated by the newlystored jitter value. For example, the jitter value associated with thedevice ID 11 is 10 ms and the jitter value for comparison is 30 ms. Thisindicates that the value of the jitter measured by the communicationdevice 11 (the device ID 11) performing the device-side third processing(refer to FIG. 6) has been changed from 30 ms to 10 ms.

As shown in FIG. 7, the CPU 111 determines whether or not the inputoperation to end the teleconference has been detected via the inputportion 118 (step S137). When it is determined that the input operationto end the teleconference has not been detected (no at step S137), theCPU 111 returns the processing to step S131. When it is determined thatthe input operation to end the teleconference has been detected (yes atstep S137), the CPU 111 ends the device-side fourth processing.

As shown in FIG. 4, after the CPU 111 starts the device-side secondprocessing (refer to FIG. 5), the device-side third processing (refer toFIG. 6) and the device-side fourth processing (refer to FIG. 7) by theprocessing at step S13, the CPU 111 acquires all the jitter values andthe jitter values for comparison stored in the table 1142 (refer to FIG.8) stored in the storage portion 114 (step S15). The CPU 111 calculatesa difference between the associated jitter value and the jitter valuefor comparison for each of the device IDs stored in the table 1142. Whenat least one of the calculated differences is not zero, the CPU 111determines that at least one of the jitter values has been changed (yesat step S17). The CPU 111 performs processing (first setting processing,refer to FIG. 9) that sets a first provisional time based on the jittervalue stored in the table 1142 (step S19). The first provisional time isa candidate when a final combined time is set by processing at step S23that will be explained later. After the CPU 111 ends the first settingprocessing, the CPU 111 advances the processing to step S21. Meanwhile,when all of the plurality of calculated differences are zero, the CPU111 determines that none of the jitter values have been changed (no atstep S17). The CPU 111 advances the processing to step S21.

It should be noted that, in the above explanation, the CPU 111 maycompare each of the plurality of calculated differences with apredetermined threshold value (10 ms, for example). In this case, theCPU 111 may determine that at least one of the jitter values has beenchanged when at least one of the calculated differences is larger thanthe predetermined threshold value. Meanwhile, the CPU 111 may determinethat none of the jitter values have been changed when none of thecalculated differences are larger than the predetermined thresholdvalue.

The first setting processing will be explained with reference to FIG. 9.The CPU 111 refers to the table 1142 (refer to FIG. 8) and acquires thejitter value that is associated with the device ID of the communicationdevice 11 (step S41). The CPU 111 refers to the table 1142 and acquiresthe jitter value associated with the device ID of one of either thecommunication device 12 or the communication device 13 (in accordancewith an order in which the device IDs are arranged, or an order in whichthe device IDs are stored in the table 1142, for example) (step S43).Based on the two jitter values acquired by the processing at step S41and step S43, the CPU 111 calculates a combined jitter value. Thecombined jitter value is calculated, for example, as a square root of avalue obtained by squaring and adding each of the two jitter values(step S45). Hereinafter, the calculated value is referred to as combinedjitter or as a combined jitter value. The CPU 111 stores the combinedjitter value in the RAM 113 (step S45). The CPU 111 determines whetheror not the jitter values associated with all the device IDs of theparticipants in the teleconference have been acquired by the processingat step S43 (step S47). When it is determined that the jitter valuesassociated with all of the device IDs have not been acquired (no at stepS47), the CPU 111 returns the processing to step S43. Among theplurality of jitter values associated with the device IDs 12 and 13, theCPU 111 acquires the jitter value associated with another device ID thathas not been acquired in the processing at step S43 (step S43), in anorder in which the device IDs are arranged, or in accordance with astorage order in the table 1142, for example. The CPU 111 then repeatsthe processing at step S45. When it is determined that the jitter valuesassociated with all the device IDs have been acquired at step S43 (yesat step S47), the CPU 111 advances the processing to step S49.

Among the combined jitter values stored in the RAM 113 by the processingat step S45, the CPU 111 selects the largest combined jitter value(hereinafter referred to as largest jitter or largest jitter value)(step S49). The CPU 111 determines a communication state of the network20 by applying the selected largest jitter value to the table 1141(refer to FIG. 10) (step S50). For example, as the communication state,the CPU 111 determines which range the selected largest jitter valuebelongs to, among a plurality of jitter ranges registered in the table1141. Based on the table 1141, the CPU 111 sets the first provisionaltime that corresponds to the determined communication state (step S51).The CPU 111 stores the set first provisional time in the RAM 113. TheCPU 111 ends the first setting processing and returns the processing tothe device-side first processing (refer to FIG. 4).

A method of determining the communication state of the network 20 and amethod of setting the first provisional time will be explained withreference to the table 1141 shown in FIG. 10. In the table 1141, asingle combined amount and a single first provisional time areassociated with each of the plurality of jitter ranges that indicate therange of the largest jitter. The combined amount indicates a number ofthe pieces of unit sound data 152. The time of the sound of the unitsound data 152 is 20 ms, and therefore, the first provisional times 20ms (=20 ms×1), 40 ms (=20 ms×2), 60 ms (=20 ms×3), 80 ms (=20 ms×4), 100ms (=20 ms×5) and 120 ms (=20 ms×6) are associated with the combinedamounts 1, 2, 3, 4, 5 and 6, respectively.

Of the plurality of jitter ranges of the table 1141, the CPU 111identifies the jitter range that includes the largest jitter valueselected by the processing at step S49 (refer to FIG. 9). When theidentified jitter range is equal to or less than 50 ms, the CPU 111determines the communication state of the network 20 to be a first state(step S50, refer to FIG. 9). The first state indicates a state of thenetwork 20 that is stable in comparison to a second state that will beexplained later. Thus, the first provisional times are set to thecombined times that are equal to or less than 100 ms (20 to 100 ms) thatcorrespond to each of the jitter ranges (step S51, refer to FIG. 9). Onthe other hand, when the identified jitter range is larger than 50 ms,the CPU 111 determines the state of the network 20 to be the secondstate (step S50). The second state indicates a state of the network 20that is unstable in comparison to the first state described above. Thus,the first provisional time is set to the maximum combined time of 120 msin the table 1141 (step S51).

Note that in the present embodiment, an example is shown in which, thefirst state and the second state are determined in accordance with thelargest jitter value when the threshold value is 50 ms. However, thepresent disclosure is not limited to the case in which the thresholdvalue is 50 ms. The threshold value that is used when determining thefirst state and the second state may be a selected value. For example,the threshold value may be any one of 10 ms, 20 ms, 30 ms and 40 ms,which are the respective lower limit values of each of the plurality ofjitter ranges in the table 1141. For example, when the threshold valueis 40 ms, the first state may be determined when the largest jittervalue is equal to or less than 40 ms (step S50), and the firstprovisional times corresponding to each of the jitter ranges equal to orless than 40 ms may be set (step S51). On the other hand, the secondstate may be determined when the largest jitter value is larger than 40ms (step S50), and the first provisional time may be set to 100 ms.

As shown in FIG. 4, the CPU 111 performs processing (second settingprocessing, refer to FIG. 11) that sets a second provisional time basedon a category of data included in the communication packet 153 that istransmitted during the teleconference (step S21). Similarly to the firstprovisional time that is set by the first setting processing (refer toFIG. 9), the second provisional time is a candidate when the combinedtime is finally set by processing at step S23 that will be explainedlater.

The second setting processing will be explained with reference to FIG.11. The CPU 111 determines whether or not an operation to share theshared document between the communication device 11 and thecommunication devices 12 and 13 that are participating in theteleconference has been detected via the input portion 118 (step S61).When it is determined that the operation to share the shared documenthas been detected, the CPU 111 transmits a shared document packet, whichincludes data of the shared document, to the server 16. Note that whenthe CPU 161 of the server 16 receives the shared document packet that istransmitted from the communication device 11, the CPU 161 identifies theconference ID of the teleconference in which the communication device 11that has transmitted the shared document packet is participating, basedon a management table. The CPU 161 identifies, as the device IDs of thecommunication devices 11, 12 and 13 that are participating in the sharedteleconference, the device IDs 11, 12 and 13 that are associated withthe same conference ID as the conference ID identified in the managementtable. Among the identified device IDs 11, 12 and 13, the CPU 161transmits the received shared document packet to the communicationdevices 12 and 13 that have the device IDs 12 and 13 other than thedevice ID 11 of the communication device 11, which has originallytransmitted the shared document packet. When the CPU 111 of each of thecommunication devices 12 and 13 receives the shared document packettransmitted from the server 16, the CPU 111 displays the shared documenton the display 116, based on data of the shared document included in thereceived shared document packet.

Further, when the CPU 111 of the communication device 11 detects theoperation to share the shared document, the transmission of the shareddocument packet is started and thus the CPU 111 of the communicationdevice 11 determines that a state is obtained in which the shareddocument packet is being transmitted (yes at step S61). The CPU 111determines the communication state of the network 20 to be the secondstate (step S66). This is because the size of the shared document dataincluded in the shared document packet is larger than the size of thedata included in the other communication packets 153, and when theshared document packet is transmitted, there is a high possibility thatthe state of the network 20 may become unstable. The CPU 111 sets thesecond provisional time to 120 ms, which is the maximum combined time inthe table 1141 (refer to FIG. 10) (step S67). The CPU 111 stores the setsecond provisional time in the RAM 113. The CPU 111 ends the secondsetting processing and returns the processing to the device-side firstprocessing (refer to FIG. 4).

When the CPU 111 does not detect the operation to share the shareddocument data, the CPU 111 determines that a state is obtained in whichthe shared document packet is not being transmitted (no at step S61).Next, the CPU 111 refers to the RAM 113 and determines whether or not asetting is stored that allows the server 16 to transmit the videocaptured by the camera 115 to the communication devices 12 and 13 (stepS63). Note that that the settings that allow or prohibit the server 16from transmitting the video captured by the camera 115 to thecommunication devices 12 and 13 are received via the input portion 118and stored in the RAM 113. When it is determined that an operation toallow the server 16 to transmit the video to the communication devices12 and 13 has been detected, the CPU 111 compresses data of the videocaptured by the camera 115 and sequentially generates frames of videothat is compressed using intra-frame compression and frames of videothat is compressed using inter-frame compression. The frame of videocompressed using intra-frame compression includes data in which onlyvideo data inside a frame is compressed. The frame of video compressedusing inter-frame compression includes data of a difference betweenprevious and following frames. Hereinafter, the video compressed usingintra-frame compression is referred to as intra-frame compressed videoand the video compressed using inter-frame compression is referred to asinter-frame compressed video. A compression ratio when generating theinter-frame compressed video is larger than a compression ratio whengenerating the intra-frame compressed video, and thus, the size of theintra-frame compressed video is larger than the size of the inter-framecompressed video.

The CPU 111 generates the intra-frame compressed video or theinter-frame compressed video. The CPU 111 generates a video packet thatincludes a type of the video as a header and transmits the video packetto the server 16. Note that when the CPU 161 of the server 16 receivesthe video packet transmitted from the communication device 11, the CPU161 identifies the conference ID of the teleconference in which thecommunication device 11 is participating, based on the management table.The CPU 161 identifies, as the device IDs of the communication devices11, 12 and 13 participating in the shared teleconference, the device IDs11, 12 and 13 that are associated with the same conference ID as theconference ID identified in the management table. Of the identifieddevice IDs 11, 12 and 13, the CPU 161 transmits the received videopacket to the communication devices 12 and 13 that have the device IDs12 and 13 other than the device ID 11 of the communication device 11,which has originally transmitted the video packet. When the CPU 111 ofeach of the communication devices 12 and 13 receives the video packettransmitted from the server 16, the CPU 111 displays the video capturedby the camera 115 on the display 116, based on the data of theintra-frame compressed video or of the inter-frame compressed videoincluded in the received video packet.

In addition, when the setting that allows the transmission from theserver 16 to the communication devices 12 and 13 is stored, thetransmission of the video packet is started, and thus the CPU 111 of thecommunication device 11 determines that a state is obtained in which thevideo packet is being transmitted (yes at step S63). The CPU 111acquires, from the header of the video packet, the type of the video(the intra-frame compressed video or the inter-frame compressed video)included in the video packet being transmitted. The CPU 111 determineswhether or not the acquired type is the intra-frame compressed video(step S65). When the CPU 111 determines that the acquired type is theintra-frame compressed video (yes at step S65), the CPU 111 determinesthe communication state of the network 20 to be the second state (stepS66). This is because the size of the intra-frame compressed video islarger than the size of data included in the other communication packets153, and when the video packet including the intra-frame compressedvideo data is transmitted, there is a high possibility that the state ofthe network 20 may become unstable. The CPU 111 sets the secondprovisional time to 120 ms, which is the maximum combined time in thetable 1141 (step S67). The CPU 111 stores the set second provisionaltime in the RAM 113. The CPU 111 ends the second setting processing andreturns the processing to the device-side first processing (refer toFIG. 4).

On the other hand, when the CPU 111 determines that the video packet isnot being transmitted (no at step S63), or determines that the type ofthe video acquired from the OS is the inter-frame compressed video (noat step S65), the CPU 111 determines the communication state of thenetwork 20 to be the first state (step S68). This is because whenneither the shared document packet nor the video packet is beingtransmitted, or when the video packet that includes the inter-framecompressed video data is being transmitted, the size of the data beingtransmitted is smaller than the size of the data of the shared documentpacket or the video packet that includes the intra-frame compressedvideo data, and thus there is a high possibility that the state of thenetwork 20 is stable. The CPU 111 reads, from the RAM 113, the combinedtime that is repeatedly set by the processing at step S23 (refer to FIG.4) that will be explained later, and sets the read combined time as thesecond provisional time (step S69). The CPU 111 stores the set secondprovisional time in the RAM 113. The CPU 111 ends the second settingprocessing and returns the processing to the device-side firstprocessing (refer to FIG. 4).

As shown in FIG. 4, after the second setting processing (step S21) isended, the CPU 111 reads the first provisional time set by the firstsetting processing (step S19) and the second provisional time set by thesecond setting processing (step S21) from the RAM 113. Of the read firstprovisional and second provisional times, the CPU 111 finally sets thelargest value as the combined time (step S23). The CPU 111 stores theset combined time in the RAM 113. It should be noted that when the firstsetting processing is not performed (when it is no at step S17), thesecond provisional time stored in the RAM 113 is finally set as thecombined time.

The CPU 111 determines whether or not the unit sound data 152corresponding to the combined time stored in the RAM 113 is stored inthe second storage portion 15B (refer to FIG. 2) (step S25). When it isdetermined that the unit sound data 152 corresponding to the combinedtime is not stored in the second storage portion 15B (no at step S25),the CPU 111 advances the processing to step S31. When it is determinedthat the unit sound data 152 corresponding to the combined time isstored in the second storage portion 15B (yes at step S25), the CPU 111generates the communication packet 153 that includes the unit sound data152 corresponding to the combined time (step S27). Specifically, the CPU111 generates the communication packet 153 that includes a piece of theunit sound data 152 when the combined time set by the processing at stepS23 is 20 ms. Similarly, the CPU 111 generates the communication packet153 that includes two pieces of the unit sound data 152 when thecombined time is 40 ms, the communication packet 153 that includes threepieces of the unit sound data 152 when the combined time is 60 ms, thecommunication packet 153 that includes four pieces of the unit sounddata 152 when the combined time is 80 ms, the communication packet 153that includes five pieces of the unit sound data 152 when the combinedtime is 100 ms, and the communication packet 153 that includes sixpieces of the unit sound data 152 when the combined time is 120 ms. TheCPU 111 transmits the generated communication packet 153 to the server16 via the network 20 (step S29). Note that when the server 16 receivesthe communication packet 153 transmitted from the communication device11, the server 16 transmits the communication packet 153 to thecommunication devices 12 and 13. Thus, by the processing at step S29,the CPU 111 transmits the communication packet 153 to the communicationdevices 12 and 13 via the server 16.

It should be noted that the CPU 111 generates the unit sound data 152corresponding to 20 ms×N at a 20 ms×N cycle, and stores the generatedunit sound data 152 in the second storage portion 15B. Thus, when theCPU 111 sets the combined time to 20 ms×N and determines that the unitsound data 152 corresponding to 20 ms×N are stored in the second storageportion 15B (yes at step S25), the cycle is also set to 20 ms×N, whichis a time period during which the sampling data corresponding to 20 ms×Nare stored in the first storage portion 15A. As a result, the CPU 111transmits the communication packet 153 generated at step S27 to theserver 16 at a cycle corresponding to the combined time.

The CPU 111 determines whether or not an input operation to end theteleconference has been detected via the input portion 118 (step S31).When it is determined that the input operation to end the teleconferencehas not been detected (no at step S31), the CPU 111 returns theprocessing to step S15. When it is determined that the input operationto end the teleconference has been detected (yes at step S31), the CPU111 ends the device-side first processing.

The server-side first processing and the server-side second processingthat are performed by the CPU 161 of the server 16 will be explainedwith reference to FIG. 12 and FIG. 13. When the CPU 161 has receivedaccess to a URL corresponding to a specific conference room from atleast one of the communication devices 15, the CPU 161 establishes asession corresponding to the specific conference room with the at leastone communication device 15. When the session has been established, theserver-side first processing and the server-side second processing arestarted by the CPU 161 executing programs stored in the storage portion164. The server-side first processing and the server-side secondprocessing are performed for each session corresponding to a conferenceroom. The server-side first processing and the server-side secondprocessing corresponding to the specific session are performed inparallel to the server-side first processing and the server-side secondprocessing corresponding to another session. Further, the server-sidefirst processing and the server-side second processing corresponding tothe specific session are also performed in parallel with each other.

The server-side first processing will be explained with reference toFIG. 12. The CPU 161 determines whether or not the measurement packettransmitted from the communication device 15 has been received (stepS151). When it is determined that the measurement packet has not beenreceived (no at step S151), the CPU 161 advances the processing to stepS155. When it is determined that the measurement packet has beenreceived (yes at step S151), the CPU 161 returns the receivedmeasurement packet to the communication device 15 that transmitted themeasurement packet (step S153). The CPU 161 advances the processing tostep S155. Note that the CPU 111 of the communication device 15calculates the jitter by transmitting the measurement packet to theserver 16 and receiving the measurement packet from the server 16 in thedevice-side third processing (refer to FIG. 6) (step S119, refer to FIG.6).

The CPU 161 determines whether or not the session that has beenestablished with respect to the specific conference room has ended (stepS155). When it is determined that the session corresponding to thespecific conference room is continuing to be established (no at stepS155), the CPU 161 returns the processing to step S151. When it isdetermined that the session that has been established with respect tothe specific conference room has ended (yes at step S155), the CPU 161ends the server-side first processing.

The server-side second processing will be explained with reference toFIG. 13. The CPU 161 determines whether or not the first notificationpacket transmitted from the communication device 15 has been received(step S171). When it is determined that the first notification packethas not been received (no at step S171), the CPU 161 advances theprocessing to step S175. When it is determined that the firstnotification packet has been received (yes at step S171), the CPU 161acquires the device ID and the jitter value that are included in thereceived first notification packet. The CPU 161 generates the secondnotification packet that includes the acquired ID and jitter value.Based on the management table, the CPU 161 identifies the conference IDof the teleconference in which the communication device 15 thattransmitted the first notification packet is participating. The CPU 161identifies the device IDs associated with the same conference ID as theconference ID identified in the management table, as the device IDs ofthe communication devices 15 that are participating in the sharedteleconference. The CPU 161 transmits the generated second notificationpacket to the communication devices 15 having the identified device IDs(step S173). The CPU 161 advances the processing to step S175. Note thatthe CPU 111 of the communication device 15 receives the secondnotification packet from the server 16 in the device-side fourthprocessing (refer to FIG. 7) and stores the device ID and the jittervalue in association with each other in the table 1142 (step S135, referto FIG. 7).

The CPU 161 determines whether or not the session established withrespect to the specific conference room has ended (step S175). When itis determined that the session corresponding to the specific conferenceroom is continuing to be established (no at step S175), the CPU 161returns the processing to step S171. When it is determined that thesession established for the specific conference room has ended (yes atstep S175), the CPU 161 ends the server-side second processing.

As explained above, the CPU 111 of the communication device 11 sets thefirst provisional time and the second provisional time in accordancewith whether the communication state is the first state or the secondstate (step S19, step S21) and sets the combined time (step S23). Thecombined time is a time period of sound in sound data that is includedin the communication packet 153, and is also a transmission cycle of thecommunication packet 153. By setting the combined time in accordancewith the communication state, the CPU 111 can adjust the transmissioncycle when transmitting the communication packet 153 to thecommunication devices 12 and 13 participating in the teleconference. Thelonger the cycle at which the communication packet 153 is transmittedfrom the communication device 11 to the communication devices 12 and 13,the higher the possibility that jitter will be low. The lower thejitter, the more favorable the quality of the sound output from thecommunication devices 12 and 13 based on the sound data. Thus, by theCPU 111 setting the combined time in accordance with the communicationstate and optimizing jitter performance, it is possible to suppressdeterioration in communication quality in the teleconference.

The CPU 111 of the communication device 11 finally determines, as thecombined time, the larger of the set first provisional time and secondprovisional time (step S23). In other words, of the first provisionaltime and the second provisional time that are set using differentmethods, the CPU 111 sets as the combined time, the time that provides agreater jitter suppression effect. As a result, the CPU 111 canappropriately suppress deterioration in the communication quality of theteleconference.

The CPU 111 of the communication device 11 calculates, as the jittervalue (step S119), a degree of variation in the time from transmittingthe measurement packet to the server 16 (step S105) to then receivingthe measurement packet that is returned from the server 16 (step S107).The CPU 111 of the communication device 11 acquires the jitter valuesthat are calculated, respectively, by each of the communication devices11, 12 and 13 participating in the teleconference (step S131 and stepS133), and calculates a plurality of combined jitter values (step S45).The CPU 111 determines the communication state based on the largestjitter value among the calculated plurality of combined jitter values(step S50) and sets the first provisional time (step S51). Based on thefirst provisional time and the second provisional time, the CPU 111finally sets the combined time (step S23). The CPU 111 transmits thecommunication packet 153 at the cycle corresponding to the set combinedtime (step S29).

In the table 1141 that is used when the CPU 111 sets the firstprovisional time, the larger the largest jitter value is, the larger thevalue of the combined time that is associated with it. In other words,the larger the largest jitter value is, the larger the value of thecombined time that is determined as the first provisional time. Thelonger the transmission cycle of the communication packet 153 that istransmitted from the communication device 11, the higher the possibilitythat jitter will be low. In response to this, by the above-describedprocessing, the CPU 111 can lengthen the combined time the larger thelargest jitter value is, and thus lengthen the transmission cycle of thecommunication packet 153. As a result, the CPU 111 can effectivelysuppress jitter by lengthening the transmission cycle of thecommunication packet 153 the larger the largest jitter value is. In thismanner, the CPU 111 can effectively suppress deterioration in thecommunication quality of the teleconference.

Further, in the above-described processing, the CPU 111 determines thecommunication state based on the largest jitter value among theplurality of calculated combined jitter values (step S50) and sets thefirst provisional time (step S51). When the first provisional time isfinally set as the combined time, of the communication devices 12 and 13participating in the teleconference, the jitter performance is optimizedwith whichever of the communication devices 12 and 13 the communicationstate is more unstable. Thus, the CPU 111 can effectively suppressdeterioration in the communication quality with all of the communicationdevices 12 and 13 that are participating in the teleconference.

When the shared document packet is transmitted from the communicationdevice 11, the size of the data included in the shared document packetis large and thus there is a high possibility that jitter will increase.In response to this, when it is determined that the shared documentpacket is being transmitted (yes at step S61), the CPU 111 can suppressjitter by setting the second provisional time to the largest value (120ms) (step S67), thus lengthening the transmission cycle of the shareddocument packet. In this manner, the CPU 111 can suppress deteriorationin the communication quality of the teleconference even when thecommunication state of the network 20 is unstable as a result of thetransmission of the shared document packet.

When the video packet that includes the intra-frame compressed videodata is transmitted from the communication device 11, the size of thedata included in the video packet is large and thus there is a highpossibility that jitter will increase. In response to this, when it isdetermined that the video packet including the intra-frame compressedvideo data is being transmitted (yes at step S65), the CPU 111 cansuppress jitter by setting the second provisional time to the largestvalue (120 ms) (step S67), thus lengthening the transmission cycle ofthe video packet. In this manner, the CPU 111 can suppress deteriorationin the communication quality of the teleconference even when thecommunication state of the network 20 is unstable due to thetransmission of the video packet that includes the intra-framecompressed video data.

When the sampling data of 20 ms of sound is stored in the first storageportion 15A, the CPU 111 generates the unit sound data 152 bycompressing the sampling data (step S87). As described above, thegeneration cycle of the unit sound data 152 is the same as the timeperiod of 20 ms when the sampling data corresponding to 20 ms is storedin the first storage portion 15A. Further, the CPU 111 sets, as thecombined time, one of the times of 20 ms, 40 ms, 60 ms, 80 ms, 100 msand 120 ms (step S19, step S21, step S23). As a result, thecommunication packet 153 is transmitted from the communication device 11at the cycle corresponding to the combined time (step S29), and is thustransmitted at the cycle 20 ms×N, which is an integral multiple of thegeneration cycle 20 ms of the unit sound data 152. The CPU 111 cantherefore transmit the communication packet 153 that includes the unitsound data 152 corresponding to the combined time 20 ms×N, at a timingat which the sampling data corresponding to the combined time 20 ms×N isstored in the first storage portion 15A. The CPU 111 can thereforeefficiently generate the unit sound data 152 from the sampling data andcan transmit the communication packet 153 that includes the unit sounddata 152 corresponding to the combined time without any delay.

The present disclosure is not limited to the above-described embodiment,and various modifications are possible. In the above-describedembodiment, the unit sound data 152 is generated by compressing thesampling data (step S87), and next, the communication packet 153 thatincludes the number of pieces of unit sound data 152 corresponding tothe set combined time is generated (step S27). In contrast to this,compressed data that is obtained by compressing the sampling datacorresponding to the set combined time may be included in thecommunication packet 153. This will be explained as follows. Afterdetermining the combined time using the same method as in theabove-described embodiment, in the device-side second processing (referto FIG. 5), the CPU 111 of the communication device 11 may determinewhether the sampling data corresponding to the combined time is storedin the first storage portion 15A (step S83). When it is determined thatthe sampling data corresponding to the combined time is stored in thefirst storage portion 15A (yes at step S83), the CPU 111 may acquire thesampling data corresponding to the combined time (step S85). The CPU 111may compress the acquired sampling data corresponding to the combinedtime and may thereby generate sound data (step S87). The CPU 111 maystore the generated sound data in the second storage portion 15B (stepS89). In this case, at step S25 of the device-side first processing(refer to FIG. 4), the CPU 111 may always determine that the sound datacorresponding to the combined time is stored in the second storageportion 15B (yes at step S25). The CPU 111 may generate thecommunication packet 153 that includes the sound data corresponding tothe combined time (step S27) and may transmit the communication packet153 at the cycle corresponding to the combined time (step S29).

In the device-side first processing (refer to FIG. 4), the CPU 111 ofthe communication device 11 finally sets, as the combined time, thelargest value among the first provisional time and the secondprovisional time, by performing the processing at step S23. In contrastto this, the CPU 111 may finally set the first provisional time as thecombined time, or may finally set the second provisional time as thecombined time. Further, the CPU 111 may switch whether to set the firstprovisional time or the second provisional time as the combined timedepending on settings. When the processing at step S29 is performed, theCPU 111 may measure the cycle of the combined time set at step S23, andmay thus determine the transmission timing of the communication packet153. When it is determined that the transmission timing has beenreached, the CPU 111 may transmit, to the server 16, the communicationpacket 153 that is generated by the processing at step S27.

In the first setting processing (refer to FIG. 9), the CPU 111 of thecommunication device 11 calculated the plurality of combined jittervalues, based on the jitter value measured by the communication device11 and the plurality of jitter values measured by the communicationdevices 12 and 13, respectively (step S45). The CPU 111 applies thelargest jitter value among the plurality of calculated combined jittervalues to the table 1141, determines the communication state and setsthe first provisional time (step S50, step S51). In contrast to this,the CPU 111 may select, as the largest jitter value, the largest jittervalue among the plurality of jitter values measured by each of thecommunication devices 11 to 13, and may thus determine the communicationstate and set the first provisional time. Alternatively, the CPU 111 mayapply the jitter value measured by the communication device 11 to thetable 1141 and may thus determine the communication state and set thefirst provisional time. The CPU 111 may set the first provisional timeusing, in place of the table 1141, a predetermined relational expressionthat indicates a relationship between the jitter and the combined time.

In the second setting processing (refer to FIG. 11), the CPU 111 of thecommunication device 11 determines the communication state in accordancewith the transmission state of the shared document packet and the videopacket, and in accordance with the type of the video included in thevideo packet, and sets the second provisional time. In contrast to this,the CPU 111 may acquire the size of the data included in thecommunication packet 153 and may determine the communication state andset the second provisional time in accordance with the acquired size ofthe data. For example, the CPU 111 may determine that the communicationstate is the first state and set 20 ms as the second provisional timewhen the acquired size of the data is smaller than a predeterminedthreshold value, and the CPU 111 may determine that the communicationstate is the second state and set 120 ms as the second provisional timewhen the acquired size of the data is equal to or larger than thepredetermined threshold value.

In the device-side second processing (refer to FIG. 5), the CPU 111generates the unit sound data 152 by compressing the sampling data ofsound corresponding to 20 ms, by performing the processing at step S87.In contrast to this, the CPU 111 may generate the unit sound data 152 bycompressing the sampling data of sound corresponding to a predeterminedperiod of time that is other than 20 ms. A minimum period of time thatcan be set as the combined time is not limited to 20 ms, and it may beanother selected period of time. The period of time of the sound of theunit sound data 152 may be different to the minimum period of time thatcan be set as the combined time. The first storage portion 15A and thesecond storage portion 15B may be provided in a storage device otherthan the RAM 113.

In the device-side third processing (refer to FIG. 6), the CPU 111calculates the delay time based on the time t1 when the measurementpacket is transmitted to the server 16 and the time t2 when themeasurement packet is received from the server 16. A transmission timewhen the measurement packet is transmitted from the communication device11 to the server 16, and a transmission time when the measurement packetis transmitted from the server 16 to the communication device 11 areincluded in this delay time. In contrast to this, the CPU 111 mayacquire, as the delay time, the transmission time when the measurementpacket is transmitted from the communication device 11 to the server 16,or the transmission time when the measurement packet is transmitted fromthe server 16 to the communication device 11. The CPU 111 may transmitthe measurement packet that is addressed to the communication devices 12and 13 participating in the teleconference to the server 16. When theCPU 161 of the server 16 receives the measurement packet transmittedfrom the communication device 11, the CPU 161 may forward the receivedmeasurement packet to each of the communication devices 12 and 13. Whenthe CPU 111 of each of the communication devices 12 and 13 receives themeasurement packet from the server 16, the CPU 111 may return themeasurement packet to the server 16. When the CPU 161 of the server 16receives the measurement packets from the communication devices 12 and13, the CPU 161 may forward the received measurement packets to thecommunication device 11. When the CPU 111 of the communication device 11receives the measurement packet transmitted from the server 16, the CPU111 may calculate the delay time based on a time at which the CPU 111transmitted the measurement packet and a time at which the CPU 111received the measurement packet. The CPU 111 may transmit, in order, aplurality of measurement packets that include a plurality of data ofdiffering sizes. The CPU 111 may calculate, as jitter, an average valuein place of the standard deviation.

For example, when the CPU 111 of the communication device 11 starts thedevice-side first processing, the CPU 111 may cause a screen, on whichan email address and a password can be input, to be displayed on thedisplay 116. When an operation to input the email address and thepassword is detected via the input portion 118, the CPU 111 may identifyat least one teleconference in which the user corresponding to the inputemail address and password can participate. The CPU 111 may cause ascreen, on which the identified at least one teleconference can beselected, to be displayed on the display 116. In this way, the user canparticipate in a selected teleconference by selecting one of the atleast one teleconferences displayed on the display 116.

Further, the CPU 111 may transmit the input email address and passwordto the server 16. The CPU 161 of the server 16 may authenticate the userusing the received email address and password. When the authenticationis successful, the CPU 161 may identify the at least one teleconferencein which the user can participate, and may transmit the conference ID ofthe identified at least one teleconference to the communication device15. Based on the conference ID received from the server 16, the CPU 111of the communication device 15 may identify the at least oneteleconference in which the user corresponding to the input emailaddress and password can participate.

The CPU 111 may transmit, to the server 16, a request packet thatincludes the device ID of the communication device 11 and the conferenceID of the teleconference selected by the user. When the CPU 161 of theserver 16 receives the request packet, the CPU 161 may associate thedevice ID and the conference ID included in the request packet with eachother and may store the associated data in a management table stored inthe storage portion 164.

In the processing at step S11, the CPU 111 may determine whether or notthe input operation to select the at least one teleconference has beendetected via the input portion 118. When the input operation to selectthe teleconference has been detected (yes at step S11), the CPU 111 maystart the selected teleconference.

The apparatus and methods described above with reference to the variousembodiments are merely examples. It goes without saying that they arenot confined to the depicted embodiments. While various features havebeen described in conjunction with the examples outlined above, variousalternatives, modifications, variations, and/or improvements of thosefeatures and/or examples may be possible. Accordingly, the examples, asset forth above, are intended to be illustrative. Various changes may bemade without departing from the broad spirit and scope of the underlyingprinciples.

What is claimed is:
 1. A non-transitory computer-readable medium storingcomputer-readable instructions, the instructions, when executed by aprocessor of a communication device configured to connect a network,performing processes comprising: a first judgment operation judgingwhether sampling data of sound for a period of time equal to or greaterthan a predetermined period of time is stored in a first storageportion; a first generation operation sequentially generating, inresponse to the first judgment operation judging that the sampling dataof sound for the period of time equal to or greater than thepredetermined period of time is stored in the first storage portion,unit sound data by sequentially compressing the sampling data in thefirst storage portion for the predetermined period of time in an orderof storage in the first storage portion; a storage operation storing theunit sound data in a second storage portion; a determination operationdetermining whether a communication state of the network is one of afirst state and a second state different from the first state based onat least one of transmission data transmitted to the network andreception data received from the network; a setting operation setting acombined time corresponding to a length of time of sound in sound dataincluded in a single packet, the combined time being one of: a firstperiod of time when the determination operation determines that thecommunication state is the first state; and a second period of timelonger than the first period of time when the determination operationdetermines that the communication state is the second state; a secondjudgment operation judging whether the unit sound data for a period oftime equal to or greater than the combined time is stored in the secondstorage portion; a second generation operation generating the packetincluding the unit sound data for the combined time in response to thesecond judgment operation judging that the unit sound data for theperiod of time equal to or greater than the combined time is stored inthe second storage portion; and a transmission operation transmitting,to at least one counterpart device at a cycle corresponding to thecombined time, the packet generated by the second generation operation.2. The non-transitory computer-readable medium according to claim 1,wherein the instructions, when executed by the processor of thecommunication device, perform the processes further comprising ameasurement operation measuring first jitter, the first jitterindicating a degree of variation in at least one of a first delay timeand a second delay time, the first delay time being from when thetransmission data is transmitted to a conference server to when thetransmission data is received by the conference server, and a seconddelay time being from when the reception data is transmitted by theconference server to when the reception data is received by thecommunication device, the conference server connected to the network andconducting a teleconference among the communication device and aplurality of the counterpart devices, and wherein the determinationoperation determines that the communication state is the first statewhen the first jitter is a first value, and determines that thecommunication state is the second state when the first jitter is asecond value greater than the first value.
 3. The non-transitorycomputer-readable medium according to claim 2, wherein the instructions,when executed by the processor of the communication device, perform theprocesses further comprising an acquisition operation acquiring aplurality of second jitter indicating a degree of variation in at leastone of a plurality of third delay times and a plurality of fourth delaytimes, each of the third delay times being from when each of theplurality of counterpart devices transmits the transmission data to theconference server to when the conference server receives thetransmission data, and each of the fourth delay times being from whenthe reception data is transmitted by the conference server to when thereception data is received by each of the plurality of counterpartdevices, and wherein the determination operation determines that thecommunication state is the first state when a largest jitter, from amongthe first jitter and the second jitter, is a first value, and determinesthat the communication state is the second state when the largest jitteris a second value that is larger than the first value.
 4. Thenon-transitory computer-readable medium according to claim 3, whereinthe largest jitter is selected from among a plurality of combinedjitter, each of the combined jitter being defined by combining the firstjitter and one of the plurality of the second jitter.
 5. Thenon-transitory computer-readable medium according to claim 1, whereinthe instructions, when executed by the processor of the communicationdevice, perform the processes further comprising a third judgmentoperation judging whether document data is being transmitted to at leastone of the counterpart devices, the document data indicating a documentto be shared in a teleconference, and wherein the determinationoperation determines that the communication state is the first state inresponse to the third judgment operation judging that the document datais not being transmitted, and determines that the communication state isthe second state in response to the third judgment operation judgingthat the document data is being transmitted.
 6. The non-transitorycomputer-readable medium according to claim 1, wherein the instructions,when executed by the processor of the communication device, perform theprocesses further comprising a third judgment operation judging whetherintra-frame compressed image data is being transmitted to at least oneof the counterpart devices in a teleconference, and wherein thedetermination operation determines that the communication state is thefirst state in response to the third judgment operation judging that theintra-frame compressed image data is not being transmitted, anddetermines that the communication state is the second state in responseto the third judgment operation judging that the intra-frame compressedimage data is being transmitted.
 7. The non-transitory computer-readablemedium according to claim 1, wherein the first generation operationgenerates the unit sound data at a first cycle, and wherein thetransmission operation transmits the packet at one of a plurality ofsecond cycles that are each an integral multiple of the first cycle. 8.The non-transitory computer-readable medium according to claim 1,wherein the instructions, when executed by the processor of thecommunication device, perform the processes further comprising a thirdjudgment operation judging whether the communication state has changed,wherein the determination operation determines that the communicationstate is one of the first state and the second state in response to thethird judgment operation judging that the communication state haschanged.
 9. A non-transitory computer-readable medium storingcomputer-readable instructions, the instructions, when executed by aprocessor of a communication device, performing processes comprising: adetermination operation determining whether a communication state with aconference server via a network is one of a first state and a secondstate different from the first state based on at least one oftransmission data transmitted by the communication device to theconference server and reception data received by the communicationdevice from the conference server; a setting operation setting a firstperiod of time as a combined time in response to the determinationoperation determining that the communication state is the first state,and setting, as the combined time, a second period of time that islonger than the first period of time in response to the determinationoperation determining that the communication state is the second state;a first generation operation generating, from sampling data of soundstored in a first storage portion, sound data for the combined time, bysequentially compressing the sampling data for the combined time in anorder of storage in the first storage portion; a second generationoperation generating a packet including the sound data; and atransmission operation transmitting the packet to the conference serverat a cycle corresponding to the combined time.
 10. The non-transitorycomputer-readable medium according to claim 9, wherein the firstgeneration operation comprises: a third generation operationsequentially generating unit sound data by sequentially compressing thesampling data for the predetermined period of time in the order ofstorage of the sampling data in the first storage portion, the unitsound data being obtained by compressing the sampling data for apredetermined period of time equal to or less than the combined time;and a storage operation storing the unit sound data generated by thethird generation operation in the second storage portion, wherein theinstructions, when executed by the processor of the communicationdevice, perform the processes further comprising a judgment operationjudging whether the unit sound data for a period of time equal to orgreater than the combined time is stored in a second storage portion,and wherein the second generation operation generates a packet includingthe unit sound data for the combined time in response to the judgmentoperation judging that the unit sound data for the period of time equalto or greater than the combined time is stored in the second storageportion.
 11. A communication device capable of communication with aplurality of counterpart devices via a network, the communication devicecomprising: a processor; and a memory storing computer-readableinstructions, the instructions, when executed by the processor,performing processes comprising: a first judgment operation judgingwhether sampling data of sound for a period of time equal to or greaterthan a predetermined period of time is stored in a first storageportion; a first generation operation sequentially generating, inresponse to the first judgment operation judging that the sampling dataof sound for the first period of time equal to or greater than thepredetermined period of time is stored in the first storage portion,unit sound data by sequentially compressing the sampling data in thefirst storage portion for the predetermined period of time in an orderof storage in the first storage portion; a storage operation storing theunit sound data in a second storage portion; a determination operationdetermining whether a communication state of the network is one of afirst state and a second state different from the first state, based onat least one of transmission data that is transmitted to the network andreception data received from the network; a setting operation setting acombined time corresponding to a length of time of sound in sound dataincluded in a single packet, the combined time being one of: a firstperiod of time when the determination operation determines that thecommunication state is the first state; and a second period of timelonger than the first period of time when the determination operationdetermines that the communication state is the second state; a secondjudgment operation judging whether the unit sound data for a period oftime equal to or greater than the combined time is stored in the secondstorage portion; a second generation operation generating the packetincluding the unit sound data for the combined time in response to thesecond judgment operation judging that the unit sound data for theperiod of time equal to or greater than the combined time is stored inthe second storage portion; and a transmission operation transmitting,to at least one counterpart device at a cycle corresponding to thecombined time, the packet generated by the second generation operation.12. The communication device according to claim 11, wherein theinstructions, when executed by the processor, perform the processesfurther comprising a measurement operation measuring first jitter, thefirst jitter indicating a degree of variation in at least one of a firstdelay time and a second delay time, the first delay time being from whenthe transmission data is transmitted to a conference server to when thetransmission data is received by the conference server, and a seconddelay time being from when the reception data is transmitted by theconference server to when the reception data is received by thecommunication device, the conference server connected to the network andconducting a teleconference among the communication device and aplurality of the counterpart devices, and wherein the determinationoperation determines that the communication state is the first statewhen the first jitter is a first value, and determines that thecommunication state is the second state when the first jitter is asecond value greater than the first value.
 13. The communication deviceaccording to claim 12, wherein the instructions, when executed by theprocessor, perform the processes further comprising: an acquisitionoperation acquiring a plurality of second jitter indicating a degree ofvariation in at least one of a plurality of third delay times and aplurality of fourth delay times, each of the third delay times beingfrom when each of the plurality of counterpart devices transmits thetransmission data to the conference server to when the conference serverreceives the transmission data, and each of the fourth delay times beingfrom when the reception data is transmitted by the conference server towhen the reception data is received by each of the plurality ofcounterpart devices, and wherein the determination operation determinesthat the communication state is the first state when a largest jitter,from among the first jitter and the second jitter, is a first value, anddetermines that the communication state is the second state when thelargest jitter is a second value that is larger than the first value.14. The communication device according to claim 13, wherein the largestjitter is selected from among a plurality of combined jitter, each ofthe combined jitter being defined by combining the first jitter and oneof the plurality of the second jitter.
 15. The communication deviceaccording to claim 11, wherein the instructions, when executed by theprocessor, perform the processes further comprising a third judgmentoperation judging whether document data is being transmitted to at leastone of the counterpart devices; and wherein the determination operationdetermines that the communication state is the first state when it isjudged by the third judgment operation that the shared document data isnot being transmitted, and determines that the communication state isthe second state when it is judged by the third judgment operation thatthe shared document data is being transmitted.
 16. The communicationdevice according to claim 11, wherein the instructions, when executed bythe processor, perform the processes further comprising a third judgmentoperation judging whether intra-frame compressed image data is beingtransmitted to at least one of the counterpart devices in ateleconference, and wherein the determination operation determines thatthe communication state is the first state in response to the thirdjudgment operation judging that the intra-frame compressed image data isnot being transmitted, and determines that the communication state isthe second state in response to the third judgment operation judgingthat the intra-frame compressed image data is being transmitted.
 17. Thecommunication device according to claim 11, wherein the first generationoperation generates the unit sound data at a first cycle, and whereinthe transmission operation transmits the packet at one of a plurality ofsecond cycles that are each an integral multiple of the first cycle. 18.The communication device according to claim 11, wherein theinstructions, when executed by the processor of the communicationdevice, perform the processes further comprising a third judgmentoperation judging whether the communication state has changed, whereinthe determination operation determines that the communication state isone of the first state and the second state in response to the thirdjudgment operation judging that the communication state has changed.